Method, apparatus, electronic device, storage medium, and computer program for media content processing
The described method and device for media content processing address the limitation of generating emotional objects by allowing users to create and arrange expression objects based on media content, thereby improving user interaction and experience.
Patent Information
- Application Number
- JP2024568015
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-08-15
- Filing Date
- 2023-08-14
- Publication Date
- 2025-06-10
- Estimated Expiration
- 2043-08-14
AI Technical Summary
Existing media content processing methods lack the capability to efficiently generate emotional objects based on media content, limiting user expression and interaction.
A method and device for media content processing that displays media content, determines target media content, and generates expression objects based on user instructions, allowing these objects to be arranged on an expression selection panel.
Enables users to generate personalized expression objects from media content, enhancing user experience, enriching media content utilization, and improving interaction efficiency.
Smart Images

Figure 2025517722000001_ABST
Abstract
Description
Technical Field
[0001] Cross - reference to related applications This application claims the priority of a Chinese patent application with the application number 202210977422.9, which was filed with the China National Intellectual Property Administration on August 15, 2022, and incorporates all of its content herein by reference.
[0002] Embodiments of the present disclosure relate to the field of computer technology, for example, methods, devices, devices, and storage media for media content processing.
Background Art
[0003] With the rapid development of Internet technology, interactions between users have become increasingly convenient, and users can perform various information interactions through applications.
[0004] Interactions based on emotional objects such as emojis are a way to express emotions in images. Compared with character information, emotional objects can express users' emotions more vividly and have been widely applied. Emotional objects are often provided by applications, and users can use the emotional objects in the application to chat, comment, etc.
Summary of the Invention
Problems to be Solved by the Invention
[0005] Embodiments of the present disclosure provide a method, device, storage medium, and device for media content processing that can optimize the media content processing method and generate emotional objects based on media content.
Means for Solving the Problems
[0006] According to a first aspect, embodiments of the present disclosure include: displaying media content including images and / or videos in a target media work on the preset page of the current application; Determining at least one target media content in the media content; Generating at least one target expression object based on the at least one target media content in response to an expression object generation instruction for the at least one target media content; The at least one target expression object is arranged on an expression selection panel of the current application, providing a method for processing media content.
[0007] According to a second aspect, an embodiment of the present disclosure is A media content display module configured to display media content including images and / or videos in a target media work on a preset page of the current application; A target content determination module configured to determine at least one target media content in the media content; An expression object generation module configured to generate at least one target expression object based on the at least one target media content in response to an expression object generation instruction for the at least one target media content; The at least one target expression object is arranged on an expression selection panel of the current application, further providing a device for processing media content.
[0008] According to a third aspect, an embodiment of the present disclosure is One or more processors; A storage device configured to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement a method for processing media content according to an embodiment of the present disclosure, further providing an electronic device.
[0009] According to a fourth aspect, an embodiment of the present disclosure further provides a storage medium including computer-executable instructions that, when executed by a computer processor, execute a method for media content processing according to an embodiment of the present disclosure.
Brief Description of the Drawings
[0010] In the drawings, the same or similar reference numerals indicate the same or similar elements. It should be understood that the drawings are schematic and the components and elements are not necessarily drawn to scale.
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Modes for Carrying Out the Invention
[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the protection scope of the present disclosure.
[0012] It should be understood that each step described in the embodiments related to the method of the present disclosure may be executed in a different order and / or executed in parallel.
[0013] As used herein, the term "comprising" and its variations are in an open form and mean "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment", the term "another embodiment" means "at least one another embodiment", and the term "some embodiments" means "at least some embodiments". Related definitions of other terms will be described later.
[0014] It should be noted that the concepts such as "first", "second", etc. mentioned in the present disclosure are only for distinguishing different devices, modules or units, and do not limit the order or interdependence of the functions executed by these devices, modules or units.
[0015] It should be noted that the modifications of "one" and "a plurality" mentioned in the present disclosure are not limiting but exemplary, and those skilled in the art should understand "one or more" unless otherwise specified in the context.
[0016] The names of the messages or information interacted between multiple devices in the embodiments of the present disclosure are only for the purpose of explanation and do not limit the scope of these messages or information.
[0017] Before using the technical solutions disclosed in each embodiment of the present disclosure, it should be understood that the type, scope of use, usage scenarios, etc. of the personal information related to the present disclosure should be notified to the user in an appropriate manner based on relevant laws and the approval of the user should be obtained.
[0018] For example, in response to receiving an active request from a user, information is sent to the user to clearly prompt that it is necessary to obtain and use the user's personal information through an operation requested by the user. As a result, based on the prompt information, the user can independently choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that executes the operations of the technical solution of the present disclosure.
[0019] As an optional but non-limiting implementation method, the method of sending prompt information to the user in response to receiving an active request from the user may be, for example, in the form of a pop-up window. The prompt information may be displayed in text in the pop-up window. Additionally, the pop-up window may further be equipped with a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.
[0020] It should be understood that the above notification and user permission acquisition process are merely exemplary and do not limit the implementation methods of the present disclosure. Other methods that comply with relevant laws may also be applied to the implementation methods of the present disclosure.
[0021] It should be understood that the data related to this technical solution (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of relevant laws and regulations.
[0022] FIG. 1 is a flowchart of a method for media content processing according to an embodiment of the present disclosure. The embodiments of the present disclosure are applicable to the case of media content processing. The method may be executed by a device for media content processing. The device may be implemented in the form of software and / or hardware, and optionally, may be implemented by an electronic device. The electronic device may be a mobile terminal such as a mobile phone, a smart watch, a tablet computer, and a personal digital assistant, or may be a device such as a personal computer (PC) terminal or a server.
[0023] As shown in FIG. 1, the method includes step 101 of displaying media content including images and / or videos in a target media work on a preset page of a current application.
[0024] In an embodiment of the present disclosure, the current application may be a preset application, the preset page may be a page in the preset application, and the preset application can provide a media work display function and an expression object generation function. Exemplarily, when the user needs to use the expression object generation function, the user may open the preset page in the preset application. The media work includes one or more pieces of media content, and the media content may include images and / or videos, and may further include audio, etc., and is not specifically limited. The image may include a still image, or may include a dynamic image such as a Graphics Interchange Format (GIF). The video frame of the image or video may include image content and / or text content, etc.
[0025] In an embodiment of the present disclosure, the target media work may be understood as the media work to which the media content currently displayed on the preset page belongs. The media content currently displayed on the preset page may include all or part of the media content in the target media work, and the display method may be the same as or different from the display method of the target media work. For example, for the display method of the target media work, the media content may be displayed as a thumbnail, for example, the image size or ratio is reduced.
[0026] Before delivering the media work, the distributor of the media work may set the attribute information of each media content in the media work, and the attribute information may be used to indicate whether the corresponding media content permits other users to generate an expression object. The attribute information corresponding to the media content displayed on the preset page indicates that it is permitted to be used to generate an expression object, that is, the function of generating an expression object based on the media content in the media work has obtained sufficient permission from the distributor of the media work.
[0027] Exemplarily, FIG. 2 is a schematic diagram of an interface according to an embodiment of the present disclosure. As shown in FIG. 2, on the preset page 201, media content 202 is displayed, and the displayed media content is part of the media content in the target media work. The fourth media content is not fully shown, but different media content can be switched by inputting operations such as sliding to the left or sliding to the right. The target media work may include only one media content, for example, one image, and in this case, all or part of the content of the media content may be displayed.
[0028] In step 102, at least one target media content is determined in the media content.
[0029] In an embodiment of the present disclosure, the target media content may be understood as media material for generating an expression object, and the determination of the target media content may be automatically determined by the current application or may be autonomously determined by the user.
[0030] Optionally, determining at least one target media content in the media content includes determining at least one selected media content as at least one target media content in response to a selection operation on the media content. The advantage set in this way is to enable the user to more freely select the target media content so as to realize the personalized customization of the expression object.
[0031] Exemplarily, while displaying media content on a preset page, selection controls corresponding to each media content, such as check boxes or positioning cursors, etc., may be displayed, and the user can select the media content that they want to use to generate an expression object by inputting a selection operation through the selection control. After receiving the user's selection operation on the media content, in response to the selection operation by the user, the selected media content is determined as the target media content.
[0032] As shown in FIG. 2, a check box 203 may be displayed on the media content, and the user can select the media content to which the check box belongs by checking the check box. For example, the first media content in FIG. 2 is selected.
[0033] Optionally, when only one media content is included in the target media work, the media content may be automatically determined as the target media content.
[0034] In step 103, in response to the expression target generation instruction for the at least one target media content, at least one target expression target is generated based on the at least one target media content, and the at least one target expression target is arranged on the expression selection panel of the current application.
[0035] Exemplarily, after receiving the expression target generation instruction for the target media content, media resources corresponding to the target media content, such as image data or video frame data, etc., are acquired, and related operations such as image processing, format conversion, or encoding are performed on the acquired media resources to generate corresponding target expression targets. The expression target may be an object such as an emoji or an expression sticker.
[0036] Optionally, a preset generation control may be displayed on the preset page, and the user can input an expression target generation instruction by triggering the preset generation control. As shown in FIG. 2, the "Add" button 204, which is a preset generation control, is displayed, and when the user clicks the "Add" button 204, a target expression target can be generated.
[0037] In an embodiment of the present disclosure, the target expression object is arranged on the expression selection panel of the current application, and the user can select the target expression object based on the expression selection panel and apply the target expression object. Optionally, the generated target expression object may be used for information interaction such as sending an instant message including the target expression object or posting a comment message including the target expression object. The generated target expression object may be added to the expression library in the preset application, and thus can be displayed on the expression selection panel in the preset application so as to be selected by the user. For example, the target expression object may be added to the custom expression set in the expression library. Optionally, the target expression object can be used for information interaction between the current user (i.e., the user who triggered the generation of the target expression object) and the distributor of the target media work, improving the interaction experience between the two.
[0038] The method for media content processing according to an embodiment of the present disclosure is to display media content including an image and / or a video in a target media work on a preset page of the current application, determine at least one target media content in the media content, and generate a target expression object based on the target media content in response to an expression object generation instruction for the target media content. The target expression object is arranged on the expression selection panel of the current application. By adopting the above technical solution, in the process of browsing a media work, the user can generate an expression object based on the media content in the media work and arrange the generated expression object on the expression selection panel of the current application, so as to meet the user's personalized expression object generation needs, enrich the style of the expression object, and enable more personalized selections when the user tries to select and apply the expression object on the expression selection panel, improving the user experience. At the same time, it can enrich the uses of the media content in the media work and improve the utilization rate of the media content resources.
[0039] In some embodiments, the target media work includes a target image work, and the target image work includes at least one image, that is, one or more images. Exemplarily, the target image work further includes audio. When the target image work is displayed, the audio may be used as background music. Multiple images can be played in a preset order one by one, and loop playback is also possible.
[0040] FIG. 3 is a flowchart of another method for processing media content according to an embodiment of the present disclosure. Taking the case where the target media work is a target image work as an example, the above optional embodiment will be described. The method may include the following steps.
[0041] In step 301, at least one image in the target image work is displayed on the preset page of the current application.
[0042] Exemplarily, when the target image work includes multiple images, when displaying the images in the target image work, the images may be displayed one by one, or batch display may be performed. The number of batch-displayed images is less than or equal to the total number of images in the target image work, and the display order of the images may be consistent with the order of the images when the target image work is displayed.
[0043] Exemplarily, as shown in FIG. 2, the media content 202 may be an image in the target image work.
[0044] In step 302, in response to a selection operation on at least one image, the selected at least one image is determined as at least one target image.
[0045] Exemplarily, as shown in FIG. 2, the target image may be determined based on the user's selection operation on the checkbox.
[0046] In step 303, in response to an expression target generation instruction for at least one target image, at least one target expression target is generated based on the at least one target image.
[0047] Optionally, one target expression target includes one or more target images.
[0048] Exemplarily, each target image may generate one target expression target alone, or may integrate two or more target images to generate one target expression target. For example, a target expression target with a dynamic image effect may be generated based on two or more target images.
[0049] Optionally, the target expression target includes a dynamic expression target, and the dynamic expression target is generated from a dynamic image in the at least one target image and / or a plurality of still images in the at least one target image.
[0050] Optionally, in order to meet different expression target generation needs of the user, preset generation controls corresponding to the two generation methods, for example, the "add separately" button which is the first preset generation control and the "integrated addition" button which is the second preset generation control, may be displayed on the preset page.
[0051] According to the method for media content processing according to the embodiments of the present disclosure, in the process of the user browsing an image work, the user can independently select an image in the image work and generate one or more expression targets based on the one or more images selected by the user. Therefore, it can meet the user's personalized expression target generation needs, enrich the style of the expression target, improve the user experience, at the same time enrich the uses of the images in the image work, and improve the utilization rate of the image resources.
[0052] In some embodiments, the target media work includes a target video work, and the target video work includes a plurality of video frames.
[0053] FIG. 4 is a flowchart of still another method for processing media content according to an embodiment of the present disclosure. Taking the case where the target media work is a target video work as an example, the above selective embodiment will be described. The method may include the following steps.
[0054] In step 401, video progress information corresponding to the target video work is displayed on the preset page of the current application.
[0055] Exemplarily, the video progress information may be a progress bar, or may be a video frame sequence, video chapter information, etc. When it is a video frame sequence, the displayed video frame sequence may include all or part of the video frames (which may be thumbnail images) in the target video work, and the order of the video frames in the video frame sequence may be consistent with the playback order of the video frames in the target video work.
[0056] FIG. 5 is a schematic diagram of another interface according to an embodiment of the present disclosure, and a video frame sequence 502 of a video work is displayed on the preset page 501.
[0057] In step 402, in response to a video frame selection operation on the video progress information, at least one set of target video frames is determined, and each set of target video frames includes at least one video frame.
[0058] Exemplarily, a certain number of individual video frames (which may be understood as one or more video snapshots) in the target video work may be selected and used for generating an expression object. One or more sets of consecutive video frames (which may be understood as one or more video segments) in the target video work may be selected and used for generating an expression object. The video frame selection operation may be a selection operation on one video frame or a batch selection operation on a plurality of video frames.
[0059] Exemplarily, for the selection of video segments, in this step, in response to the start frame selection operation and the end frame selection operation on the video progress status information, the start video frame and the end video frame are determined, and based on the start video frame and the end video frame, at least one set of target video frames is determined. Each set of target video frames includes one start video frame, one end video frame, and zero or at least one intermediate video frame. The intermediate video frame is located between the corresponding start video frame and the corresponding end video frame in the video progress status information. The advantage of such a setting is that by conveniently selecting video segments, the corresponding expression object can be quickly generated based on the video segments. Optionally, the set of target video frames may include only at least one intermediate video frame.
[0060] The start frame selection operation is used to select the start video frame, and the end frame selection operation is used to select the end video frame. The start frame selection mark and the end frame selection mark may be associated and displayed in the video progress status information. The user can determine the start video frame by adjusting the position pointed to by the start frame selection mark, and can determine the end video frame by adjusting the position pointed to by the end frame selection mark.
[0061] Exemplarily, the start frame selection mark and the end frame selection mark may be displayed as a pair, and a pair of marks corresponds to one set of target video frames. For one set of target video frames, if there is no intermediate video frame between the start video frame and the end video frame, the set of target video frames includes two video frames, namely, the start video frame and the end video frame.
[0062] Exemplarily, as shown in FIG. 5, a video frame selection box 503 is associated with and displayed in the video frame sequence 502. The left boundary of the video frame selection box 503 may be understood as a start frame selection marker, and the right boundary may be understood as an end frame selection marker. The user can adjust the range of the selected video frames by dragging the left or right boundary of the video frame selection box 503.
[0063] In step 403, in response to an expression target generation instruction for at least one target video frame set, at least one target expression target is generated based on the at least one target video frame set.
[0064] Optionally, one target expression target includes one or more target video frame sets.
[0065] Exemplarily, each target video frame set may separately generate one target expression target, or two or more target video frame sets may be combined to generate one target expression target.
[0066] Optionally, the target expression target includes a dynamic expression target, and the dynamic expression target is generated by a target video frame set among the at least one target video frame set.
[0067] Optionally, on the preset page, preset generation controls corresponding to the two generation methods, for example, the "generate separately" button which is the third preset generation control and the "integrated generation" button which is the fourth preset generation control, may be displayed to meet different expression target generation needs of the user.
[0068] According to the method for media content processing according to an embodiment of the present disclosure, in the process of a user viewing a video work, video frames in the video work can be autonomously selected, and one or more expression objects can be generated based on one or more sets of video frames selected by the user, satisfying the user's personalized expression object generation needs, enriching the styles of the expression objects, improving the user experience, and at the same time enriching the uses of the video content in the video work and improving the utilization rate of video resources.
[0069] In some embodiments, before generating at least one target expression object based on the at least one target media content, generating at least one preview expression object based on the at least one target media content, and further including displaying the at least one preview expression object. The advantage set in this way is that a preview function can be provided before generating the expression object, the user can view the effect of the expression object in advance, avoid repeated corrections, and improve the expression object generation efficiency.
[0070] Optionally, when there are multiple preview expression objects, one or more preview expression objects may be displayed.
[0071] Exemplarily, the preview expression object may be displayed on the preset page or in a target display area other than the preset page. For example, as shown in FIGS. 2 and 5, a target display area may be set above the preset page 201 and above the preset page 501, and the preview expression object may be displayed in the target display area.
[0072] In some embodiments, the method further includes receiving an editing operation on the at least one preview expression target, and generating at least one target expression target based on the at least one target media content includes generating at least one target expression target based on the at least one target media content and the editing result of the editing operation. The advantage set in this way is that by enabling the user to perform editing based on the preview expression target, the generated target expression target can better fit the user's own needs. The editing operation may include, for example, adding text, adding a stamp, or adjusting the size.
[0073] In some embodiments, before displaying the media content in the target media work on the preset page of the current application, on the target display page of the target media work of the current application, in response to a first preset trigger operation on the preset page, further including displaying the preset page. The advantage set in this way is that in the process of the user browsing the target media work, it is possible to conveniently enter the preset page.
[0074] Optionally, the first preset trigger operation may be a trigger operation on the preset entry of the preset page, or an operation for triggering the entry into the preset page acting on the preset page, such as a double-click operation.
[0075] Optionally, the preset entry is an entry control on the target display page, for example, a "Convert to Expression" button, etc., and by triggering the preset entry, the display of the preset page can be triggered.
[0076] Optionally, the size of the preset page may be the same as or different from the size of the target display page. When the size of the preset page is smaller than the size of the target display page, the preset page may be overlapped on the upper layer of the target display page. In this case, the target media work may continue to be displayed on the target display page, and the user can also continue to view the target media work during the process of setting the expression.
[0077] In an embodiment of the present disclosure, the target media work may be attached with a work tag, and the work tag may be used, for example, to indicate the type of the media work to which it belongs or the topic related to the media work to which it belongs. Exemplarily, when the distributor of the target media work distributes the target media work, a work tag may be added to the target media work. The preset label may include a work tag related to the expression, and may be called a preset expression tag. For example, it may include tags such as #emoji#, #expression#, #compete image#, #emoticon#, or #new expression#.
[0078] In some embodiments, in the process of displaying the target media work on the target display page, in response to a second preset trigger operation, displaying a preset control display area on the target display page, determining whether a preset label is attached to the target media work, and when the preset label is attached to the target media work, displaying a preset entry of the preset page at a first preset display position in the preset control display area. The advantage of this setting is that the display position of the preset entry can be flexibly determined based on whether the preset label is attached to the target media work. When the preset label is attached to the target media work, it is to be displayed at the preset display position.
[0079] Exemplarily, the preset control display area may include preset interaction controls, such as a watch together control, a like press control, a share control, and a comment control, etc., and may also include preset function controls, such as a save control, etc. The first preset display position may be a fixed position preset in the preset control display area, or may be a relative position determined based on the display positions of the preset interaction controls and / or preset function controls in the preset control display area. The relative positional relationship between the first preset display position and the current display position may be preset.
[0080] In some embodiments, after determining whether a preset label is attached to the target media work, if the preset label is not attached to the target media work, it further includes displaying a preset entry of the preset page at a second preset display position in the preset control display area, and the display priority of the first preset display position is higher than that of the second preset display position. The advantage of such a setting is that when a preset label is attached, it indicates that the target media work is more likely to be used to generate expressions. By displaying the preset entry at a position with a higher display priority, it can be made easier for the user to trigger the preset entry. When the preset label is not attached to the target media work, the display priority may be slightly lower, and the control display can be performed by reasonably using the preset control display area.
[0081] FIG. 6 is a flowchart of another media content processing method according to an embodiment of the present disclosure. The embodiments of the present disclosure will be described based on the optional manner in the above embodiments. This method includes the following steps.
[0082] In step 601, in the process of displaying the target media work on the target display page of the current application, in response to the second preset trigger operation, a preset control display area is displayed on the target display page.
[0083] FIG. 7 is a schematic diagram of interface interaction according to an embodiment of the present disclosure. Exemplarily, taking the case where the target media work is a target image work as an example, when the target image work is displayed on the target display page 701 and the second image in the target image work is displayed, the user inputs a long-press operation (preset trigger operation) on the target display page 701, and a preset control display area 702 is displayed on the target display page 701.
[0084] In step 602, it is determined whether a preset label is attached to the target media work. If the determination is affirmative, step 603 is executed. If no preset label is attached to the target media work, step 604 is executed.
[0085] Optionally, step 602 may be executed before the preset control display area is displayed on the target display page. After the preset control display area is displayed, the display position of the preset entrance can be directly determined based on the determination result of step 602, so as to improve the display speed of the preset entrance.
[0086] As shown in FIG. 7, when the target image work is attached with an #emoji# tag (preset label), step 603 can be executed.
[0087] In step 603, a preset entrance of the preset page is displayed at the first preset display position in the preset control display area, and step 605 is executed.
[0088] Exemplarily, the display priority of the preset display position may be determined based on the relative positional relationship between the preset display position and the display positions of the preset interaction control and / or the preset function control in the preset control display area.
[0089] For example, as shown in FIG. 7, the preset entry is the expression addition button 703, and the preset function control is the save button 704. When the target image work has a preset label, the expression addition button 703 is displayed before the save button 704. When the target image work has no label, the expression addition button 703 is displayed after the save button 704. For example, the expression addition button 703 and the save button 704 are swapped in position, or the expression addition button 703 is replaced with another control, such as the view together control, and the expression addition button 703 is installed after the save button 704, and the expression addition button 703 is displayed after the user inputs a left slide operation.
[0090] In step 604, the preset entry of the preset page is displayed at the second preset display position in the preset control display area, and the display priority of the first preset display position is higher than that of the second preset display position.
[0091] In step 605, in response to a trigger operation on the preset entry of the preset page, the preset page is displayed.
[0092] As shown in FIG. 7, when the user clicks the expression addition button 703, the preset page 705 is displayed.
[0093] In step 606, the media content in the target media work is displayed on the preset page.
[0094] As shown in FIG. 7, on the preset page 705, a plurality of images in the target image work are displayed, and a checkbox is displayed for each image.
[0095] In step 607, in response to a selection operation on media content, at least one selected media content is determined as at least one target media content.
[0096] As shown in FIG. 7, the user clicks on the checkbox of the second image including the monthly pattern, and determines the second image as the target media content.
[0097] In step 608, at least one preview expression target is generated based on at least one target media content, and at least one preview expression target is displayed.
[0098] As shown in FIG. 7, a preview expression target is generated based on the second image and displayed in the target display area 706. Optionally, when the user continues to select other images, a preview expression target can be generated and displayed based on the currently newly selected image. Optionally, the user can switch the display of different preview expression targets by triggering the media content on the preset page.
[0099] In step 609, an editing operation on at least one preview expression target is received.
[0100] As shown in FIG. 7, when the user attempts to further edit the expression target, the user clicks on the edit button to edit, for example, the character "good night" can be added, and the editing result can be displayed in real time within the target display area.
[0101] In step 610, in response to an expression target generation command for at least one target media content, at least one target expression target is generated based on at least one target media content and the editing result of the editing operation.
[0102] As shown in FIG. 7, if the user is satisfied with the current preview effect, the generation of the expression target may be instructed by clicking the add button to input an expression target generation command.
[0103] Exemplarily, if the user is satisfied with the initial preview expression target, there is no need to edit, and an expression target generation command may be input directly by clicking the add button.
[0104] In other embodiments, when the user can select multiple images or multiple video frames, the preset control display area 702 may include a "composite generation" button for synthesizing multiple images or multiple video frames into one expression target and a "generate each" button for synthesizing each expression target so that the user can select different expression target synthesis results as needed.
[0105] In step 611, at least one target expression target is arranged on the expression selection panel of the current application.
[0106] Exemplarily, after the generation of the target expression target is successful, the target expression target may be added to the expression library of the current application so as to be arranged on the expression selection panel of the current application, and the target display page may be returned to continue displaying the target media work. Also, a success notification for addition may be displayed on the target display page, such as "Expression addition successful" in FIG. 7.
[0107] According to the method for media content processing according to an embodiment of the present disclosure, during the process of a user browsing a media work, the user can conveniently trigger the display of the control display area, and determine the display position of the preset entry of the preset page for generating an expression object based on whether a preset expression tag is attached to the media work. When the user attempts to generate an expression object based on the media content in the media work, the user triggers the preset entry to enter the preset page, selects media content on the preset page, and can view the preview expression object. The user can further perform editing based on the preview expression object, and further generate a personalized expression object that meets the user's needs and add it to the expression library, which facilitates searching for and using the expression object in the expression library later, and is advantageous for improving the interaction experience with the interaction object.
[0108] FIG. 8 is a structural schematic diagram of an apparatus for media content processing according to an embodiment of the present disclosure. As shown in FIG. 8, the apparatus includes a media content display module 801, a target content determination module 802, and an expression object generation module 803.
[0109] The media content display module 801 is configured to display media content including images and / or videos in a target media work on a preset page. The target content determination module 802 is configured to determine at least one target media content in the media content. The expression object generation module 803 is configured to generate a target expression object based on the at least one target media content in response to an expression object generation instruction.
[0110] The apparatus for media content processing according to an embodiment of the present disclosure displays media content including an image and / or a video in a target media work on a preset page of a current application, determines at least one target media content in the media content, and in response to an expression target generation instruction for the target media content, generates a target expression target based on the target media content, and the target expression target is arranged on an expression selection panel of the current application. By adopting the above technical solution, in the process of browsing a media work, a user can generate an expression target based on the media content in the media work and arrange the generated expression target on the expression selection panel of the current application, thereby satisfying the user's personalized expression target generation needs, enriching the style of the expression target, enabling more personalized selections when the user tries to select and apply an expression target on the expression selection panel, improving the user experience, enriching the uses of the media content in the media work, and improving the utilization rate of media content resources.
[0111] Optionally, the target content determination module is configured to determine at least one selected media content as at least one target media content in response to a selection operation on the media content.
[0112] Optionally, the target media work includes a target image work including at least one image, the media content display module is configured to display at least one image in the target image work on a preset page of a current application, and the target content determination module is configured to determine at least one selected image as at least one target image in response to a selection operation on the at least one image.
[0113] Optionally, the target image work includes a moving image and / or a still image.
[0114] Optionally, the expression target generation module 803 is configured to generate at least one target expression target based on the target media content by generating at least one target expression target including one or more of the at least one target images based on the at least one target image.
[0115] Optionally, the target media work includes a target video work including a plurality of video frames, the media content display module is configured to display video progress information corresponding to the target video work on the preset page of the current application, and the target content determination module is configured to determine at least one target video frame set in response to a video frame selection operation on the video progress information, and each target off-frame set includes at least one video frame.
[0116] Optionally, the expression target generation module 803 is configured to generate at least one target expression target based on the at least one target media content by generating at least one target expression target based on the at least one target video frame set, and one target expression target includes one or more of the at least one target video frame sets of the at least one target expression target.
[0117] Optionally, the at least one target expression target includes a dynamic expression target, and the dynamic expression target is generated from at least one of a dynamic image in the at least one target image, a plurality of still images in the at least one target image, and a target video frame set in the at least one target video frame set.
[0118] Optionally, the target content determination module includes a video frame determination unit configured to determine a start video frame and an end video frame in response to a start frame selection operation and an end frame selection operation on the video progress status information, and a video frame set determination unit configured to determine at least one target video frame set based on the start video frame and the end video frame.
[0119] Optionally, before generating at least one target expression object based on the at least one target media content, the apparatus further includes a preview expression object generation module configured to generate at least one preview expression object based on the at least one target media content and display the at least one preview expression object.
[0120] Optionally, the apparatus further includes an editing operation reception module configured to receive an editing operation on the at least one preview expression object, and the expression object generation module 803 is configured to generate at least one target expression object based on the at least one target media content and the editing result of the editing operation, so as to generate at least one target expression object based on the at least one target media content.
[0121] Optionally, before displaying the media content in the target media work on the preset page of the current application, the apparatus further includes a preset page display module configured to display the preset page in response to a first preset trigger operation on the preset page in the target display page of the target media work of the current application.
[0122] Optionally, in the process of displaying the target media work on the target display page, the apparatus is configured to display a preset control display area on the target display page in response to a second preset trigger operation, a preset label determination module configured to determine whether a preset label is attached to the target media work, and when the preset label is attached to the target media work, a first preset entry display module configured to display a preset entry of the preset page at a first preset display position in the preset control display area.
[0123] Optionally, after determining whether a preset label is attached to the target media work, if the preset label is not attached to the target media work, the apparatus further includes a second preset entry display module configured to display a preset entry of the preset page at a second preset display position in the preset control display area, and the display priority of the first preset display position is higher than that of the second preset display position.
[0124] The media content processing apparatus according to an embodiment of the present disclosure can execute the media content processing method according to any embodiment of the present disclosure, and has functional modules and effects corresponding to the execution method.
[0125] Each unit and module included in the above apparatus is only divided according to functional logic, but is not limited to the above division, and it is sufficient if the corresponding functions can be realized. Also, the specific names of the functional units are only for distinguishing each other and do not limit the protection scope of the embodiments of the present disclosure.
[0126] FIG. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. Hereinafter, reference is made to FIG. 9 showing a schematic structural diagram of an electronic device 900 (for example, a terminal device or a server in FIG. 9) for realizing the embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (PDAs), tablet personal computers (PADs), portable media players (PMPs), in-vehicle terminals (for example, in-vehicle navigation terminals), and fixed terminals such as digital televisions (TVs) and desktop computers. The electronic device shown in FIG. 9 is only an example and does not impose any limitation on the functions and usage ranges of the embodiments of the present disclosure.
[0127] As shown in FIG. 9, the electronic device 900 may include a processing device (for example, a central processing unit, a graphics processor, etc.) 901 that can execute various appropriate operations and processes based on a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. Various programs and data necessary for the operation of the electronic device 900 are also stored in the RAM 903. The processing device 901, the ROM 902, and the RAM 903 are interconnected by a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.
[0128] Generally, an input device 906 including the following devices, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc., an output device 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc., a storage device 908 including, for example, a magnetic tape, a hard disk, etc., and a communication device 909 may be connected to the I / O interface 905. The communication device 909 may permit the electronic device 900 to perform wireless or wired communication with other devices to exchange data. In FIG. 9, an electronic device 900 having various devices is shown, but it should be understood that it is not required to implement or include all the shown devices. More or fewer devices may alternatively be implemented or included.
[0129] According to an embodiment of the present disclosure, the process described with reference to the above flowchart may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a program code for executing the method shown in the flowchart, and includes a computer program product including a computer program mounted on a non-transitory computer-readable medium. In such an embodiment, the computer program can be downloaded and installed from a network via the communication device 909, installed from the storage device 908, or installed from the ROM 902. When the computer program is executed by the processing device 901, the above functions limited in the method of the embodiment of the present disclosure are executed.
[0130] The names of messages or information interacted between multiple devices in the embodiments of the present disclosure are only for the purpose of explanation and do not limit the scope of these messages or information.
[0131] The electronic device according to an embodiment of the present disclosure belongs to the same inventive concept as the method for media content processing according to the above embodiment. For technical details not described in detail in this embodiment, reference may be made to the above embodiment, and this embodiment has the same effects as the above embodiment.
[0132] An embodiment of the present disclosure provides a computer storage medium storing a computer program, where when the program is executed by a processor, the method for media content processing according to the above embodiment is realized.
[0133] The computer-readable medium according to the present disclosure may be a computer-readable transmission medium, a computer-readable storage medium, or any combination thereof. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium include, but are not limited to, an electrical connection having one or more conductors, a portable computer magnetic disk, a hard disk, RAM, ROM, erasable programmable read-only memory (EPROM), flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium may be any tangible medium in which a program is included or stored, and the program may be used in or in combination with an instruction execution system, apparatus, or device. In the present disclosure, the computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which computer-readable program code is carried. Such a propagated data signal may adopt various forms including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer-readable signal medium may be any computer-readable medium other than the computer-readable storage medium, and the computer-readable signal medium can transmit, propagate, or transmit a program used in or in combination with an instruction execution system, apparatus, or device. The program code included in the computer-readable medium can be transmitted via any suitable medium including, but not limited to, an electric wire, an optical cable, a radio frequency (RF), or any suitable combination of these.
[0134] In some embodiments, the client and the server communicate using a currently known network protocol such as the Hyper Text Transfer Protocol (HTTP) or a network protocol to be developed in the future, and may be interconnected with digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), international networks (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as currently known networks or networks to be developed in the future.
[0135] The computer-readable medium may be included in the electronic device or may exist independently without being incorporated into the electronic device.
[0136] The computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device displays media content including images and / or videos in a target media work on a preset page of the current application, determines at least one target media content in the media content, and generates at least one target expression object based on the at least one target media content in response to an expression object generation instruction for the at least one target media content, wherein the at least one target expression object is arranged on an expression selection panel of the current application.
[0137] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The programming languages include, but are not limited to, object-oriented programming languages such as Java, Smalltalk, and C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user computer, or partially on the user computer, or executed as an independent software package, or partially on the user computer and partially on a remote computer, or entirely on a remote computer or server. When a remote computer is involved, the remote computer may be connected to the user computer via any type of network (including a LAN or WAN), or connected to an external computer (e.g., connected via the Internet using an Internet service provider).
[0138] The flowcharts and block diagrams in the drawings illustrate the possible system architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent one module, program segment, or part of code that includes one or more executable instructions for realizing a given logical function. It should be noted that as an alternative implementation, the functions described in the blocks may occur in an order different from that described in the drawings. For example, two consecutively shown blocks may actually be executed substantially in parallel, or in reverse order, as determined by such functions. Each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a system of dedicated hardware for performing a given function or operation, or may be implemented by a combination of dedicated hardware and computer instructions.
[0139] The units mentioned in the embodiments of the present disclosure may be implemented in software or in hardware. The name of a module does not limit the module itself in some cases. For example, the target content determination module may be described as "a module for determining at least one target media content in the media content".
[0140] The functions described as above in this specification may be executed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Parts (ASSP), System on Chip (SOC), Complex Programmable Logic Device (CPLD), and the like.
[0141] In the context of the present disclosure, a machine-readable medium may be a tangible medium that includes or stores a program for use in or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium includes, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination thereof. More specific examples of the machine-readable storage medium include electrical connections based on one or more wires, portable computer disks, hard disks, RAM, ROM, EPROM, or flash memory, optical fibers, portable CD-ROMs, optical storage devices, magnetic storage devices, or any suitable combination of the above.
[0142] According to one or more embodiments of the present disclosure, there is provided a method for processing media content, including: displaying media content including images and / or videos in a target media work on a preset page of a current application; determining at least one target media content in the media content; and generating at least one target expression object based on the at least one target media content in response to an expression object generation instruction for the at least one target media content, wherein the at least one target expression object is arranged on an expression selection panel of the current application.
[0143] According to one or more embodiments of the present disclosure, determining at least one target media content in the media content includes determining at least one selected media content as at least one target media content in response to a selection operation on the media content.
[0144] According to one or more embodiments of the present disclosure, the target media work includes a target image work including at least one image, and displaying media content in the target media work on a preset page of the current application includes displaying at least one image of the target image work on a preset page of the current application. Determining at least one selected media content as at least one target media content in response to a selection operation on the media content includes determining at least one selected image as at least one target image in response to a selection operation on the at least one image.
[0145] According to one or more embodiments of the present disclosure, the at least one target image work includes a moving image and / or a still image.
[0146] According to one or more embodiments of the present disclosure, generating at least one target expression object based on the target media content includes generating at least one target expression object based on the at least one target image, and one target expression object includes one or more target images of the at least one target image.
[0147] According to one or more embodiments of the present disclosure, the target media work includes a target video work including a plurality of video frames, and displaying media content in the target media work on a preset page of the current application includes displaying video progress status information corresponding to the target video work on a preset page of the current application. Determining at least one selected media content as at least one target media content in response to a selection operation on the media content includes determining at least one target video frame set in response to a video frame selection operation on the video progress status information, and each target video frame set includes at least one video frame.
[0148] According to one or more embodiments of the present disclosure, generating at least one target expression object based on the at least one target media content includes generating at least one target expression object based on the at least one target video frame set, and one target expression object includes one or more target video frame sets among the at least one target video frame set.
[0149] According to one or more embodiments of the present disclosure, the at least one target expression object includes a dynamic expression object, and the dynamic expression object is generated from at least one of a dynamic image in the at least one target image, a plurality of still images in the at least one target image, and a target video frame set in the at least one target video frame set.
[0150] According to one or more embodiments of the present disclosure, determining at least one target video frame set in response to a video frame selection operation on the video progress status information includes determining a start video frame and an end video frame in response to a start frame selection operation and an end frame selection operation on the video progress status information, and determining at least one target video frame set based on the start video frame and the end video frame.
[0151] According to one or more embodiments of the present disclosure, before generating at least one target expression object based on the at least one target media content, generating at least one preview expression object based on the at least one target media content and displaying the at least one preview expression object are further included.
[0152] According to one or more embodiments of the present disclosure, it further includes receiving an editing operation on at least one preview expression target, and generating at least one target expression target based on at least one target media content includes generating at least one target expression target based on the at least one target media content and the editing result of the editing operation.
[0153] According to one or more embodiments of the present disclosure, before displaying media content in a target media work on a preset page of the current application, on a target display page of the target media work of the current application, in response to a first preset trigger operation on the preset page, it further includes displaying the preset page.
[0154] According to one or more embodiments of the present disclosure, in the process of displaying the target media work on the target display page, in response to a second preset trigger operation, it includes displaying a preset control display area on the target display page, determining whether a preset label is attached to the target media work, and when the preset label is attached to the target media work, displaying a preset entry of the preset page at a first preset display position in the preset control display area.
[0155] According to one or more embodiments of the present disclosure, after determining whether a preset label is attached to the target media work, when the preset label is not attached to the target media work, it further includes displaying a preset entry of the preset page at a second preset display position in the preset control display area, and the display priority of the first preset display position is higher than that of the second preset display position.
[0156] According to one or more embodiments of the present disclosure, there is provided an apparatus for media content processing, including: a media content display module configured to display, on a preset page of a current application, media content including images and / or videos in a target media work; a target content determination module configured to determine at least one target media content from the media content; and an expression target generation module configured to generate at least one target expression target based on the at least one target media content in response to an expression target generation instruction for the at least one target media content, wherein the at least one target expression target is arranged on an expression selection panel of the current application.
[0157] According to one or more embodiments of the present disclosure, there is further provided an electronic device including: one or more processors; and a storage device configured to store one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement a method for media content processing according to an embodiment of the present disclosure.
[0158] According to one or more embodiments of the present disclosure, there is further provided a storage medium including computer-executable instructions that, when executed by a computer processor, perform a method for media content processing according to an embodiment of the present disclosure.
[0159] Although the operations are described in a specific order, it should not be understood that these operations are required to be executed in the specific order shown or in a chronological order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, although specific implementation details are included above, these should not be construed as limiting the scope of the present disclosure. Some features described in the context of a single embodiment may be implemented in combination in one embodiment. Conversely, various features described in the context of one embodiment may be implemented alone or in any suitable sub-combination in multiple embodiments.
[0160] Although the subject matter has been described in a language specific to structural features and / or methodological operations, it should be understood that the subject matter recited in the claims is not necessarily limited to the specific features or operations described above. The specific features and operations described as above are only exemplary forms of implementing the claims.
Claims
1. A method for media content processing, comprising: displaying media content including images and / or videos in a target media work on a preset page of a current application; determining at least one target media content from the media content; generating at least one target expression object based on the at least one target media content in response to an expression object generation command for the at least one target media content; and placing the at least one target expression object on an expression selection panel of the current application.
2. The method according to claim 1, wherein determining at least one target media content from the media content includes determining at least one selected media content as at least one target media content in response to a selection operation on the media content.
3. The target media work includes a target image work including at least one image, displaying media content in the target media work on a preset page of the current application includes displaying at least one image of the target image work on a preset page of the current application, The method according to claim 2, wherein determining at least one selected media content as at least one target media content in response to a selection operation on the media content includes determining at least one selected image as at least one target image in response to a selection operation on the at least one image.
4. The method according to claim 1, wherein at least one of the target image works includes a dynamic image and / or a still image.
5. Generating at least one target expression object based on the at least one target media content includes generating at least one target expression object based on the at least one target image, The method according to claim 3, wherein one target expression object includes one or more of the at least one target images.
6. The target media work includes a target video work including a plurality of video frames. Displaying media content in the target media work on the preset page of the current application includes displaying video progress information corresponding to the target video work on the preset page of the current application. Determining at least one selected media content as at least one target media content in response to a selection operation on the media content includes determining at least one target video frame set in response to a video frame selection operation on the video progress information. The method according to claim 2, wherein each target video frame set includes at least one video frame.
7. Generating at least one target expression object based on the at least one target media content includes generating at least one target expression object based on the at least one target video frame set. The method according to claim 6, wherein one target expression object includes one or more target video frame sets among the at least one target video frame sets.
8. The at least one target expression object includes a dynamic expression object. The method according to claim 4 or 6, wherein the dynamic expression object is generated from at least one of a dynamic image in the at least one target image, a plurality of still images in the at least one target image, and a target video frame set in the at least one target video frame set.
9. Determining at least one target video frame set in response to a video frame selection operation on the video progress information includes: Determining a start video frame and an end video frame in response to a start frame selection operation and an end frame selection operation on the video progress information; and Determining at least one target video frame set based on the start video frame and the end video frame. The method according to claim 6.
10. Before generating at least one target expression object based on the at least one target media content, generating at least one preview expression object based on the at least one target media content, and further including displaying the at least one preview expression object, the method according to claim 1.
11. Further including receiving an editing operation on the at least one preview expression object, Generating at least one target expression object based on the at least one target media content includes generating at least one target expression object based on the at least one target media content and the editing result of the editing operation, the method according to claim 10.
12. Before displaying the media content in the target media work on the preset page of the current application, on the target display page of the target media work of the current application, in response to a first preset trigger operation on the preset page, further including displaying the preset page, the method according to claim 1.
13. In the process of displaying the target media work on the target display page, in response to a second preset trigger operation, displaying a preset control display area on the target display page; Determining whether a preset label is attached to the target media work; In response to the determination result that the preset label is attached to the target media work, displaying a preset entry of the preset page at a first preset display position in the preset control display area, the method according to claim 12.
14. After determining whether a preset label is attached to the target media work, in response to the determination result that the preset label is not attached to the target media work, further including displaying a preset entry of the preset page at a second preset display position in the preset control display area, The display priority of the first preset display position is higher than that of the second preset display position, the method according to claim 13.
15. An apparatus for media content processing, A media content display module configured to display media content including images and / or videos in a target media work on a preset page of a current application; A target content determination module configured to determine at least one target media content from the media content; An expression target generation module configured to generate at least one target expression target based on the at least one target media content in response to an expression target generation instruction for the at least one target media content, the apparatus comprising: The at least one target expression target is arranged on an expression selection panel of the current application.
16. The apparatus according to claim 15, comprising a module for executing the method according to any one of claims 2 to 14.
17. At least one processor; A storage device configured to store at least one program, the electronic device comprising: When the at least one program is executed by the at least one processor, the at least one processor realizes the method according to any one of claims 1 to 14.
18. A storage medium including computer-executable instructions for executing the method according to any one of claims 1 to 14 when executed by a computer processor.
Citation Information
Patent Citations
Expression generation method and device, computer equipment and storage medium
CN114693827A