Information processing method and device, electronic equipment and storage medium
By displaying a preview window on electronic devices and supporting the editing and processing of multimedia content, the limitations of existing multimedia content operation methods are overcome, enabling convenient and efficient information processing and sharing, and meeting diverse user needs.
Patent Information
- Application Number
- CN202511027786.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-07-24
- Publication Date
- 2025-11-07
AI Technical Summary
Existing technologies for information processing and sharing on electronic devices have significant limitations in their operation methods for multimedia content such as text, images, audio, and video, failing to meet users' diverse needs for information processing and sharing. In particular, they lack convenient functions in text-to-image generation, image-to-text integration, and audio and video clip processing and sharing.
It identifies and displays multimedia content by showing a preview window on electronic devices, allowing users to edit directly within the preview window, including text-to-image generation, image-text integration, and audio and video clip editing. It provides convenient editing tools and templates, and supports personalized processing and sharing of multimedia content.
It improves the efficiency and experience of user information processing and sharing, allowing users to quickly complete personalized processing and sharing of diverse content without having to switch between multiple applications or interfaces.
Smart Images

Figure CN120909461A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application belongs to the technical field of electronic devices, and particularly relates to an information processing method and device, an electronic device, and a storage medium. BACKGROUND
[0002] In the current digital era, electronic devices have become the main tools for people to process and share information. However, when processing and sharing information on electronic devices, the current operation mode has significant limitations for various multimedia content such as text, images, audio, and video, which seriously affects the user's information processing efficiency and sharing experience, and cannot meet the user's needs in diversified information processing and sharing. SUMMARY
[0003] The embodiments of the present application provide an information processing method, device, electronic device, and storage medium, which can improve the efficiency and experience of users in processing and sharing information, thereby meeting the user's needs in diversified information processing and sharing.
[0004] In a first aspect, the embodiments of the present application provide an information processing method, which is executed by an electronic device, and the method comprises:
[0005] In response to a first input, a preview window is displayed; wherein the preview window is used to display multimedia content selected by the first input, and the multimedia content comprises at least one of the following: text, image, audio, and video.
[0006] In response to a second input, the multimedia content displayed in the preview window selected by the second input is edited in an editing area to obtain a processing result.
[0007] In a second aspect, the embodiments of the present application provide an information processing device, and the device comprises:
[0008] A display module is configured to display a preview window in response to a first input; wherein the preview window is used to display multimedia content selected by the first input, and the multimedia content comprises at least one of the following: text, image, audio, and video.
[0009] A processing module is configured to edit the multimedia content displayed in the preview window selected by a second input in an editing area to obtain a processing result in response to the second input.
[0010] In a third aspect, the embodiments of the present application provide an electronic device, which comprises a processor and a memory, wherein the memory stores programs or instructions executable on the processor, and the programs or instructions are executed by the processor to implement the steps of the information processing method according to the first aspect.
[0011] In a fourth aspect, an embodiment of the present application provides a readable storage medium, the readable storage medium storing a program or instructions, the program or instructions being executed by a processor to implement the steps of the information processing method according to the first aspect.
[0012] In a fifth aspect, an embodiment of the present application provides a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, and the processor being configured to run a program or instructions to implement the information processing method according to the first aspect.
[0013] In a sixth aspect, an embodiment of the present application provides a computer program product, the program product being stored in a storage medium, and the program product being executed by at least one processor to implement the information processing method according to the first aspect.
[0014] In the embodiment of the present application, by displaying the preview window in response to the first input, instant and intuitive feedback can be provided for the user, so that the user can quickly understand the specific situation of the multimedia content selected by the first input in the operation process, where the multimedia content covers at least one of text, image, audio and video, the type of operable object is enriched, and the demand of the user for diversified content processing in different scenarios is met. In response to the second input, the selected multimedia content in the preview window is edited in the editing area, and the processing result is obtained. This design provides a convenient and efficient content editing approach for the user, so that the user can complete personalized processing of the selected content without switching between multiple applications or interfaces, the efficiency and experience of the user in processing and sharing information can be improved, and thus the demand of the user for diversified information processing and sharing is met. BRIEF DESCRIPTION OF DRAWINGS
[0015] Figure 1 is one of flowcharts of an information processing method provided by an embodiment of the present application;
[0016] Figure 2A is one of example diagrams of an information processing method provided by an embodiment of the present application;
[0017] Figure 2B is another example diagram of an information processing method provided by an embodiment of the present application;
[0018] Figure 2C is a third example diagram of an information processing method provided by an embodiment of the present application;
[0019] Figure 3 is a fourth example diagram of an information processing method provided by an embodiment of the present application;
[0020] Figure 4 is a fifth example diagram of an information processing method provided by an embodiment of the present application;
[0021] Figure 5 Figure 2 is a flowchart of another information processing method according to an embodiment of the present application;
[0022] Figure 6A Figure 6 is an example diagram of an information processing method according to an embodiment of the present application;
[0023] Figure 6B Figure 7 is an example diagram of an information processing method according to an embodiment of the present application;
[0024] Figure 7 Figure 8 is an example diagram of an information processing method according to an embodiment of the present application;
[0025] Figure 8 Figure 9 is a structural block diagram of an information processing apparatus according to an embodiment of the present application;
[0026] Figure 9 Figure 10 is a structural schematic diagram of an electronic device according to an embodiment of the present application;
[0027] Figure 10 Figure 11 is a hardware structural schematic diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION
[0028] The technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all the embodiments obtained by those of ordinary skill in the art belong to the scope of protection of the present application.
[0029] The terms "first", "second", and the like in the specification of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than that illustrated or described herein, and the objects distinguished by "first", "second", and the like are generally of a kind and are not limited to the number of objects, for example, the first object can be one or more. In addition, "and / or" in the specification means at least one of the connected objects, and the character " / ", generally indicates that the front and rear associated objects are in an "or" relationship.
[0030] In the context of the wide application of electronic devices, users have increasingly diverse needs for information processing and sharing. However, the related art information processing methods have many problems: 1) For text, the related art text selection method is to select the text after long pressing the text. However, after completing the selection, the user can only copy and paste the selected text into other applications, and there is a lack of a convenient way to generate an image of the selected text for sharing and saving. This limitation makes the user operation process cumbersome in scenarios such as creating creative text images and sharing text opinions in the form of images on social platforms, where text needs to be presented in the form of an image. The user needs to copy and paste into an image editing application and then generate an image, which is inefficient. In addition, it is also impossible to directly set the image style of the selected text in a diversified manner, such as font, font size, background color, and other personalized adjustments, and it is difficult to quickly apply the built-in templates, making it difficult to meet the user's needs for personalized display of text in different scenarios.
[0031] 2) For images, although users can save images through the screenshot function, in actual application scenarios, users often face more complex needs. For example, a user may want to combine the selected image part with text content to generate a new image that is more personalized. However, the related art processing method cannot meet such needs, limiting the user's personalized processing and sharing of image content.
[0032] 3) For other types of objects such as audio and video, the related art also lacks convenient selection, processing, and sharing functions. Users cannot easily select audio clips or video clips and combine them with other content to generate new sharing forms, such as generating an image that displays audio waveforms and other information, generating an audio image or interactive card that contains audio cover images, clip start and end times, audio titles, and other information, or making a video clip into an interactive card that contains key frame images and video information. The lack of such functions makes it difficult for users to meet their diverse information processing and sharing needs.
[0033] To solve the above technical problems, the embodiments of the present application provide an information processing method, device, electronic device, and storage medium.
[0034] Next, the information processing method provided by the embodiments of the present application will be described in detail in conjunction with the drawings.
[0035] It should be noted that the information processing method provided by the embodiments of the present application is applicable to an electronic device, which in actual application can include a mobile terminal such as a smartphone, a tablet computer, a smartwatch, a personal digital assistant, and can also include a computer device such as a notebook computer, a desktop computer, and a desktop machine, and the embodiments of the present application do not limit this.
[0036] Figure 1 is one of flowcharts of an information processing method provided by an embodiment of the present application, as shown in Figure 1 the method can include the following steps: step 101 and step 102.
[0037] In step 101, in response to a first input, a preview window is displayed; wherein the preview window is used to display multimedia content selected by the first input, and the multimedia content includes at least one of the following: text, image, audio, and video.
[0038] In the embodiment of the present application, when a user browses an application interface containing multimedia content, such as a webpage, an article, a chat record, a music playing interface, a video playing interface, etc., the user can trigger the multimedia content selection function of the electronic device through a first input to select the multimedia content that the user wants to process.
[0039] In the embodiment of the present application, the electronic device can automatically and accurately identify the selected multimedia content in response to the first input initiated by the user, record the related information of the multimedia content, such as the content of the text, the pixel data of the image, the start and end times of the audio segment, the start and end times of the video segment, the frame information of the video, etc., and display a preview window.
[0040] In the embodiment of the present application, the form of the first input is various, which depends on the application scenario and the type of the device. In the desktop application, it can be a mouse click, a drag operation to select an area and a right-click operation, etc. In the mobile application, it can be a finger touch, a long press, a sliding selection, etc.
[0041] Exemplarily, the first input includes a long press and a sliding operation. For text, the user selects the required text part by sliding the finger after long pressing the text. For an image, the user selects the image by long pressing the image or using a specific image selection tool. For audio, the user long presses a certain position on the audio progress bar in the audio playing interface and determines the start position and the end position of the audio segment by sliding the finger. For video, the user determines the video segment by a similar selection method for audio during the video playing process.
[0042] In the embodiment of the present application, the main function of the preview window is to display the multimedia content selected by the first input, which includes at least one of the following: text, image, audio, and video. The preview window will adopt a specific display method according to different content types to provide a clear and intuitive preview effect.
[0043] In the embodiments of the present application, the display position of the preview window can be determined according to the position and type of the multimedia content selected by the first input. The preview window is usually displayed at the associated position of the selected multimedia content, so that the user can intuitively view the preview effect of the selected multimedia content. For example, for text, the preview window can be displayed beside the selected text; for images, the preview window can be displayed near the selected image. For audio and video, the preview window can be displayed in the relevant area of the play interface. In addition, the size and display manner of the preview window will not affect the user's viewing and operation of the original multimedia content.
[0044] In some embodiments, when the multimedia content includes text, the preview window is used to display the text selected by the first input in the form of an image, so that the user can generate an image from the selected text in a faster and more convenient manner and share it without tedious copy-paste or download-edit operations, thereby improving the sharing efficiency.
[0045] In the embodiments of the present application, when the preview window displays the text in the form of an image, the style information of the text in the image, such as font, font size, and background color of the image where the text is located, can be automatically set by the electronic device or pre-set by the user.
[0046] In some embodiments, when the multimedia content includes images, the preview window is used to display the image region selected by the first input in the form of a cropped preview image. As the user adjusts the selected image region, such as moving or zooming, the cropped preview image is also updated synchronously, which facilitates the user to accurately grasp the selected image content.
[0047] In some embodiments, when the multimedia content includes audio, the preview window is used to display the audio segment selected by the first input in the form of time interval markers and / or an audio waveform graph. The time interval markers include a start time and an end time, and the user can quickly understand the duration of the audio segment by viewing the time interval. The audio waveform graph is a graphical representation of the volume variation of the audio, which helps the user to quickly locate the climax, trough or silent part in the audio, and enables the user to have a clearer understanding of the audio content.
[0048] In some embodiments, when the multimedia content includes video, the preview window is used to display the video segment selected by the first input in the form of time interval markers and / or key frame thumbnails. The time interval markers include a start time and an end time, which facilitates the user to grasp the duration of the video segment. The key frame thumbnails are a series of representative image frames extracted from the video, which are arranged and displayed in the form of thumbnails. The user can quickly understand the main picture content of the video through these thumbnails, which facilitates the selection and editing of the video segment.
[0049] In the embodiments of this application, with further operation of the user on the multimedia content, the content in the preview window is updated in real time to ensure that the multimedia content in the preview window is clear and accurate, and can timely and truly reflect the result of the user operation, so that the user can adjust the selection and editing operation in time according to the preview effect.
[0050] As shown in the example, Figure 2A a text is displayed on the screen 21 of the electronic device 20, the user selects the text 22 to be processed by sliding the finger after long pressing the text, and a preview window 23 is displayed in real time beside the text 22, which shows the preview effect of the image generated by the selected text; wherein the "√" control in the preview window 23 is used to indicate confirming selection of the image in the preview window 23, and the "×" control is used to indicate confirming non-selection of the image in the preview window 23.
[0051] As can be seen from the above example, compared with the related art, the text can only be shared after long pressing to select the text and dragging to share to other applications, and the image cannot be directly generated for sharing, which leads to a complicated operation process in some scenarios where the text needs to be displayed in the form of an image, such as making creative text images, sharing text views in the form of images on social platforms, etc., and the image needs to be generated after copying and pasting to an image editing application, which is low in efficiency. In the embodiments of this application, the user can generate an image from the selected text in a faster and more convenient way through the preview window, without the tedious copying and pasting or downloading and editing operations, thereby improving the sharing efficiency.
[0052] As shown in the example, Figure 2B a text and an image are displayed on the screen 21 of the electronic device 20, the user selects the text and the image 24 to be processed by sliding the finger after long pressing the text, and a preview window 25 is displayed in real time beside the text and the image 24, which shows the preview effect of the image generated by the selected text and image; wherein the "√" control in the preview window 25 is used to indicate confirming selection of the image in the preview window 25, and the "×" control is used to indicate confirming non-selection of the image in the preview window 25.
[0053] As can be seen from the above example, compared with the related art, the image cannot be conveniently integrated with the text to generate a new image through the screenshot method, which limits the user's personalized processing and sharing of the image. In the embodiments of this application, the user can conveniently integrate the image with the text to generate a new image for sharing through the preview window, which meets the user's demand for personalized display and sharing of content in different scenarios.
[0054] As shown in the example, Figure 2CAs shown, a music playing interface is displayed on the screen 21 of the electronic device 20, and a user can select an audio segment starting from a certain position on the audio progress bar of the music playing interface by long pressing the position, and determine the length of the audio segment by sliding the finger. A preview window 26 is displayed above the audio progress bar, in which the start time and end time of the selected audio segment are shown. Due to the size of the preview window 26, the waveform graph of the audio segment is displayed below the start time and end time (not shown in the figure). The "√" control in the preview window 26 is used to indicate confirmation of selection of the audio segment in the preview window 26, and the "×" control is used to indicate confirmation of non-selection of the audio segment in the preview window 26. The processing of a video segment is similar and will not be described here.
[0055] As can be seen from the above examples, compared with the related art, there is no convenient selection, processing and sharing function for objects such as audio and video, for example, it is not possible to directly select a music segment to generate an audio image (such as an image showing audio waveform information) or a video segment to generate an interactive card containing a key frame image and video information, etc., which cannot meet the diversified needs of users in audio and video sharing. In the embodiments of the present application, not only simple processing of text and images is limited, but also convenient operation methods are extended to other object types such as audio and video, enriching the user's processing means for various types of content, stimulating the user's creative inspiration, and meeting the higher level needs of users in content creation.
[0056] As can be seen, in the embodiments of the present application, by responding to the first input, the multimedia content of multiple types such as text, image, audio, video, etc. is accurately identified, providing a flexible content selection basis for users, meeting the processing needs of different types of content, and expanding the application range of information processing. By displaying the preview window, the user can understand the progress and effect of multimedia content processing in real time and intuitively, enhancing the user's sense of control over the processing process, and helping to discover and adjust possible problems in time.
[0057] In step 102, in response to the second input, the multimedia content displayed in the preview window selected by the second input in the editing area is edited to obtain a processing result.
[0058] In the embodiments of the present application, after the user views the multimedia content in the preview window, if it is necessary to edit part or all of the content, the second input can be initiated. The second input is similar to the first input and can be designed according to specific application scenarios and devices. For example, in a desktop application, the user can click the edit button or use a shortcut key to initiate the second input; in a mobile application, the user can initiate the second input by double-clicking the preview window, dragging the preview window, or clicking the edit icon.
[0059] In the embodiments of the present application, after the electronic device receives the second input, the range of multimedia content that needs to be edited (i.e., the multimedia content displayed in the preview window selected by the second input) is determined, and an editing area is displayed on the screen; the editing area provides various editing tools and options, and the user can finely edit the selected multimedia content in the editing area to obtain the processing result.
[0060] For example, the second input includes a long press operation and a drag operation. The user can long press and drag the multimedia content in the preview window to a specified editing area to import the multimedia content in the preview window into the editing area. The imported multimedia content is displayed according to the display state in the preview window, and the user can further operate the imported multimedia content in the editing area to achieve personalized customization.
[0061] In the above example, the multimedia content in the preview window is imported into the editing area by means of the drag operation. This convenient interaction simplifies the operation process, enables the user to quickly import the required content into the editing environment, and improves the efficiency of information processing.
[0062] For example, the second input can also include a click operation, a sliding operation, and a text input operation, etc. The user can click the font, font size, background color, and other options in the editing area to adjust the text style. The user can scale, rotate, and crop the image by sliding operation. The user can input text information to edit the sharing text of audio or video. The user can also fine-tune the time interval of audio and video, etc.
[0063] In the embodiments of the present application, the electronic device performs editing processing on the multimedia content in the editing area in response to the second input initiated by the user, synchronously updates the multimedia content in the editing area, and generates the processing result. This provides a complete creation process for the user, enabling the user to customize the content according to their own needs, and ultimately obtain a processing result that meets specific requirements. The processing result can be saved for subsequent use, or directly used for sharing to other applications or platforms, meeting the user's needs in diversified content processing and sharing.
[0064] For example, when the user adjusts the font style, the electronic device applies the adjusted font to the text content. When the user performs scaling operation on the image, the electronic device displays the scaled image effect in real time. When the user adjusts the time interval of audio or video, the electronic device updates the time interval marker and the corresponding preview content.
[0065] In the embodiments of the present application, the editing area can be set according to the type of the electronic device, such as a non-foldable screen device or a foldable screen device, so that the user can better understand and use the device to edit multimedia content.
[0066] In some embodiments, when the electronic device is a non-foldable screen device, the editing area is a preset area on the screen of the non-foldable screen device; the preset area can be preset by the device or set by the user.
[0067] In the embodiments of the present application, when the electronic device is manufactured, the manufacturer can preset the screen division according to common user usage habits and content editing needs. Alternatively, the screen resolution, aspect ratio and other factors can be considered to ensure that the editing area provides a good user experience on non-foldable screen devices of different sizes and models. Alternatively, the user can customize the editing area according to their actual needs and usage preferences. For example, the user may want to adjust the editing area to the right side of the screen to display side by side with other application windows. Alternatively, the user may want to enlarge or reduce the size of the editing area to adapt to different editing tasks. The electronic device usually provides corresponding setting options to allow the user to adjust the position and size of the editing area by dragging the boundary, inputting specific dimensions, etc.
[0068] For example, as shown in Figure 3 , the editing area 32 is displayed on the right side of the screen 31 of the electronic device 30 to achieve the effect that the preview window 33 and the editing area 32 can be displayed side by side.
[0069] As can be seen, in the embodiments of the present application, on a non-foldable screen device, the editing area is a specific area on the screen of the device, which is not randomly set but determined according to specific rules to ensure the convenience of user operation and the rationality of content display.
[0070] In some embodiments, when the electronic device is a foldable screen device, the editing area is a folding area of the foldable screen device; the folding area includes at least two sub-areas, and each sub-area corresponds to a different editing processing mode.
[0071] In the embodiments of the present application, the folding area is a region of the foldable screen device that can be folded around a folding axis extending in one direction. In the unfolded state, it is located between two non-folding areas and has a unique form and function, providing more possibilities for content editing.
[0072] For example, as shown in Figure 4As shown, the folding area 41 of the folding screen device 40 is divided into three sub-areas, namely a first sub-area 411, a second sub-area 412 and a third sub-area 413. For example, the first sub-area provides a sub-body size adjustment function, the second sub-area provides a text layout automatic alignment function, and the third sub-area provides a style setting function.
[0073] It can be seen that, in the embodiment of the present application, different sub-areas of the folding area of the folding screen device can simultaneously provide different editing processing modes, enabling the user to handle multiple editing tasks in parallel on the same screen, thereby improving work efficiency.
[0074] In some embodiments, in the case where the multimedia content includes an image, the editing processing can include at least one of the following: adjusting a text attribute of the image, modifying an image parameter, applying a filter effect to a selected area, resetting a cropping range; wherein the text attribute can include at least one of the following: font, font size, color, alignment; the image parameter can include at least one of the following: size, position, rotation angle, transparency.
[0075] In the embodiment of the present application, when the image contains text, the text attribute can be adjusted to meet different display requirements. By modifying the image parameter, the appearance and layout of the image can be adjusted. The user can select a specific area in the image and apply various filter effects to it to change the color and style of the area. The user can perform a cropping operation on the image to remove unwanted parts and highlight key content.
[0076] In some embodiments, in the case where the multimedia content includes audio or video, the editing processing can include at least one of the following: recombining audio segments or video segments, adding metadata, inserting annotation information at key frame positions; wherein the metadata can include at least one of the following: title, description, cover image.
[0077] In the embodiment of the present application, the user can perform splicing, editing and other operations on multiple audio segments or video segments to combine them into a complete work. The user can also add metadata to the audio segments or video segments to facilitate the management and retrieval of audio-visual content. The user can also insert annotation information at key frame positions of the audio segments or video segments to add notes, explanations or hints to the audio-visual content.
[0078] In some embodiments, the processing result can include at least one of the following: image, interactive card.
[0079] Exemplarily, taking the editing of an audio clip as an example, in the editing area, the final interactive card can be generated according to a preset template. If the template selected by the user is music content sharing, a splicing of audio corresponding to the shared content is generated. If the template selected by the user is lyric sharing, a card corresponding to the lyrics is generated. If the template selected by the user is comment sharing, the comment with the most likes or the most collections in this time period is displayed. After receiving the corresponding interactive card such as audio sharing, the other user can long press the interactive card to trigger playing of the audio corresponding to the interactive card.
[0080] In the embodiments of the present application, images have a wide range of applications in scenarios such as creating creative text images, sharing text views in the form of images on social platforms, and other scenarios that require presenting text in the form of images. Interactive cards play an important role in scenarios such as mobile applications, web design, and smart device interfaces, thanks to their structured data storage, visual interactive functions, and composite media unit characteristics. The two forms of content editing results complement each other and provide users with more diverse and personalized information experiences.
[0081] As can be seen, in the embodiments of the present application, through the above steps 101 and step 102, the multimedia content can have a clear operation process and rich function options during preview and editing, meeting the user's needs for multimedia content processing in different scenarios.
[0082] As can be seen from the above embodiments, in the embodiments, by displaying the preview window in response to the first input, the user can be provided with immediate and intuitive feedback, so that the user can quickly understand the specific situation of the multimedia content selected by the first input during the operation process, wherein the multimedia content covers at least one of text, image, audio, and video, enriching the types of operable objects and meeting the user's needs for diversified content processing in different scenarios. In response to the second input, the selected multimedia content in the preview window is edited in the editing area and a processing result is obtained. This design provides a convenient and efficient content editing approach for the user, so that the user can complete personalized processing of the selected content without switching between multiple applications or interfaces, which can improve the efficiency and experience of the user in processing and sharing information, thereby meeting the user's needs for diversified information processing and sharing.
[0083] Figure 5 is a flowchart of a second information processing method provided by the embodiments of the present application, as shown in Figure 5 The method can include the following steps: step 501, step 502, and step 503.
[0084] In step 501, in response to the first input, a preview window is displayed; wherein the preview window is used to display multimedia content selected by the first input, and the multimedia content includes at least one of the following: text, image, audio, and video.
[0085] The content of step 501 in the embodiment of the present application is similar to that of step 101 in the embodiment shown in Figure 1 The content of step 101 in the embodiment shown in Figure 1 The content of step 101 in the embodiment shown in
[0086] In step 502, in the case of displaying multiple preview windows, in response to a third input, the multimedia content in at least two preview windows selected by the third input is spliced to obtain a spliced preview window; wherein the spliced preview window is used to display the spliced multimedia content, and the splicing process includes at least one of the following: horizontal parallel splicing, vertical stacking splicing, and intelligent layout splicing based on a preset template.
[0087] In the embodiment of the present application, the electronic device has displayed multiple preview windows according to the normal process, and each preview window displays different multimedia content. For example, one preview window displays the effect of a piece of text converted into an image, and another window displays the effect of another piece of text converted into an image; or one preview window displays the effect of image processing, and another preview window displays the waveform and parameter information of audio processing, etc.
[0088] In the embodiment of the present application, the third input is used to explicitly express the user's intention and trigger a specific multimedia content splicing operation. The user can use a mouse, a finger, etc. to initiate a third input on at least two preview windows that the user wants to splice; wherein the third input includes but is not limited to: click operation, sliding operation, long press operation, drag operation, etc.
[0089] For example, the user can use the left mouse button to hold the title bar or a specific draggable area of the first preview window, and then start dragging. During the dragging process, the electronic device will monitor the preview window selected by the user in real time. The user can select multiple preview windows by dragging them in turn, so as to include them in the selection range of the splicing operation. In addition, the currently selected preview window can be prompted to the user in a certain way (such as highlighting, displaying a selected mark, etc.).
[0090] For example, as shown in Figure 6AAs shown in FIG. 6, the screen 61 of the electronic device 60 displays the preview window 62 and the preview window 63. If the user drags the preview window 63 to the right boundary position of the preview window 62, the electronic device 60 detects that the user's splicing intention is horizontal parallel splicing. At this time, the electronic device 60 arranges the selected preview windows in the order from left to right according to the original width of the preview window, and makes them closely connected in the horizontal direction to form a new spliced preview window 64.
[0091] As shown in FIG. 6, Figure 6B As shown in FIG. 6, the screen 61 of the electronic device 60 displays the preview window 62 and the preview window 63. If the user drags the preview window 63 to the right boundary position of the preview window 62, the electronic device 60 detects that the user's splicing intention is horizontal parallel splicing. At this time, the electronic device 60 arranges the selected preview windows in the order from left to right according to the original width of the preview window, and makes them closely connected in the horizontal direction to form a new spliced preview window 64.
[0092] In the embodiments of the present application, a plurality of preset templates can also be provided, such as a "text and image mixed layout template", a "multi-image display template", and the like. The user can select a suitable template in the electronic device settings before initiating the splicing operation, or select a template through a pop-up template selection menu after dragging the preview window to the splicing operation area. The electronic device will automatically adjust the size and position of the preview window according to the layout rules of the selected template, and display the smartly laid-out multimedia content in the spliced preview window.
[0093] In step 503, in response to the second input, the multimedia content displayed in the preview window selected by the second input in the editing area is edited to obtain a processing result.
[0094] In the embodiments of the present application, the operation object of the second input includes but is not limited to the original preview window and the spliced preview window.
[0095] As can be seen, in the embodiments of the present application, in the multimedia content processing scenario, when there are a plurality of preview windows, the user often has the need to integrate the multimedia content in different preview windows in order to more comprehensively view, compare or edit. In order to meet this demand of the user, a splicing function of the multimedia content in different preview windows can be provided.
[0096] In some embodiments provided by the present application, the information processing method provided in the above Figure 1 or Figure 5 The embodiments shown in the above
[0097] In step 701, the preview image after the editing processing is displayed in the editing effect preview area in real time.
[0098] In the embodiment of the present application, an editing effect preview area can be displayed at the associated position of the editing area, wherein the editing effect preview area is used to dynamically display the editing effect of the multimedia content of the editing area.
[0099] As shown in Figure 7 , the editing area 72 is displayed at the right side of the screen 71 of the electronic device 70 to realize the effect that the preview window 73 and the editing area 72 can be displayed side by side. The editing effect preview area 74 is displayed at the left side of the editing area 72, and the two form the effect of being displayed side by side.
[0100] It can be seen that in the embodiment of the present application, in the multimedia content editing scenario, in order to improve the user experience and editing efficiency, the editing effect preview area can be set at the associated position of the editing area. The area can dynamically display the editing effect of the multimedia content in the editing area in real time, so that the user can directly see the operation result in the editing process and timely adjust the editing strategy.
[0101] The information processing method provided in the embodiment of the present application can be executed by the information processing device. In the embodiment of the present application, the information processing device is taken as an example to illustrate the information processing device provided in the embodiment of the present application.
[0102] Figure 8 is a structural block diagram of an information processing device provided in the embodiment of the present application, as shown in Figure 8 , the information processing device 800 can include a display module 801 and a processing module 802.
[0103] The display module 801 is used to display a preview window in response to a first input, wherein the preview window is used to display the multimedia content selected by the first input, and the multimedia content includes at least one of the following: text, image, audio, and video.
[0104] The processing module 802 is used to edit the multimedia content displayed in the preview window in response to a second input, to obtain a processing result.
[0105] As can be seen from the above embodiment, in this embodiment, by displaying the preview window in response to the first input, instant and intuitive feedback can be provided for the user, so that the user can quickly understand the specific situation of the multimedia content selected by the first input in the operation process, wherein the multimedia content covers at least one of text, image, audio and video, which enriches the types of operable objects and meets the user's demand for diversified content processing in different scenarios. And the multimedia content selected in the preview window is edited in the editing area in response to the second input, and the processing result is obtained. This design provides a convenient and efficient content editing approach for the user, so that the user can complete personalized processing of the selected content without switching between multiple applications or interfaces, which can improve the efficiency and experience of the user in processing and sharing information, thereby meeting the user's demand for diversified information processing and sharing.
[0106] Optionally, as an embodiment, when the multimedia content includes text, the preview window is configured to display the text selected by the first input in the form of an image; when the multimedia content includes an image, the preview window is configured to display the image region selected by the first input in the form of a cropped preview image; when the multimedia content includes audio, the preview window is configured to display the audio segment selected by the first input in the form of a time interval marker and / or an audio waveform diagram; when the multimedia content includes video, the preview window is configured to display the video segment selected by the first input in the form of a time interval marker and / or a key frame thumbnail; wherein the time interval marker includes a start time and an end time.
[0107] Optionally, as an embodiment, the processing module 802 is further configured to, when a plurality of preview windows are displayed, in response to a third input, perform splicing processing on the multimedia content in at least two preview windows selected by the third input to obtain a spliced preview window; wherein the spliced preview window is configured to display the spliced multimedia content, and the splicing processing includes at least one of horizontal parallel splicing, vertical stacking splicing and intelligent layout splicing based on a preset template.
[0108] Optionally, as an embodiment, when the multimedia content comprises an image, the editing process comprises at least one of the following: adjusting a text attribute of the image, modifying an image parameter, applying a filter effect to a selected region, resetting a cropping range; the text attribute comprises at least one of the following: font, font size, color, alignment; the image parameter comprises at least one of the following: size, position, rotation angle, transparency; when the multimedia content comprises audio or video, the editing process comprises at least one of the following: recombining audio segments or video segments, adding metadata, inserting annotation information at a key frame position; the metadata comprises at least one of the following: title, description, cover image.
[0109] Optionally, as an embodiment, when the electronic device is a non-foldable screen device, the editing area is a preset area on a screen of the non-foldable screen device; when the electronic device is a foldable screen device, the editing area is a folding area of the foldable screen device; wherein the folding area comprises at least two sub-areas, and each sub-area corresponds to a different editing processing manner.
[0110] Optionally, as an embodiment, the display module 801 is further configured to display a preview image after the editing processing in the editing effect preview area in real time.
[0111] Optionally, as an embodiment, the processing result comprises at least one of the following: an image, an interactive card.
[0112] The information processing apparatus in the embodiments of the present applicationapplicationbe an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic deviceapplicationbe a terminal or a device other than a terminal. For example, the electronic deviceapplicationbe a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an Augmented Reality (AR) / Virtual Reality (VR) device, a robot, a wearable device, an Ultra-Mobile Personal Computer (UMPC), a netbook, or a Personal Digital Assistant (PDA), and the like, or a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a kiosk, or a self-service machine, and the like. The embodiments of the present application are not limited in this regard.
[0113] The information processing apparatus in the embodiments of the present application can be an apparatus with an operating system. The operating system can be an Android operating system, an iOS operating system, or a possible operating system, and the embodiments of the present application do not make specific limitations.
[0114] The information processing apparatus provided in the embodiments of the present application can implement each process implemented by the method embodiments described above, and thus repeated descriptions are not given herein.
[0115] Optionally, as shown in Figure 9 The embodiments of the present application also provide an electronic device 900, which includes a processor 901 and a memory 902, and the memory 902 stores a program or instructions executable on the processor 901. When the program or instructions are executed by the processor 901, each step of the information processing method embodiments described above is implemented, and the same technical effects can be achieved. To avoid repetition, no further description is given herein.
[0116] It should be noted that the electronic device in the embodiments of the present application includes the mobile electronic device and the non-mobile electronic device described above.
[0117] Figure 10 FIG. 1 is a hardware structure schematic diagram of an electronic device for implementing various embodiments of the present application. The electronic device 1000 includes, but is not limited to, a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010.
[0118] Those skilled in the art can understand that the electronic device 1000 can also include a power supply (such as a battery) for supplying power to each component. The power supply can be logically connected to the processor 1010 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. Figure 10 The electronic device structure shown in FIG. 1 does not constitute a limitation on the electronic device, and the electronic device can include more or fewer components than those shown, or combine certain components, or have a different arrangement of components, which is not described herein.
[0119] The display unit 1006 is configured to display a preview window in response to a first input. The preview window is configured to display multimedia content selected by the first input, and the multimedia content includes at least one of the following: text, image, audio, and video.
[0120] The processor 1010 is configured to perform editing processing on the multimedia content displayed in the preview window in the editing area in response to a second input, to obtain a processing result.
[0121] It can be seen that, in the embodiment of the present application, by displaying the preview window in response to the first input, instant and intuitive feedback can be provided for the user, so that the user can quickly understand the specific situation of the multimedia content selected by the first input in the operation process, wherein the multimedia content covers at least one of text, image, audio and video, the type of operable object is enriched, and the needs of the user for diversified content processing in different scenarios are met. In response to the second input, the selected multimedia content in the preview window is edited in the editing area, and the processing result is obtained. This design provides a convenient and efficient content editing approach for the user, so that the user can complete personalized processing of the selected content without switching between multiple applications or interfaces, the efficiency and experience of the user in processing and sharing information can be improved, and thus the needs of the user in diversified information processing and sharing are met.
[0122] Optionally, as one embodiment, in the case that the multimedia content includes text, the preview window is configured to display the text selected by the first input in the form of an image; in the case that the multimedia content includes an image, the preview window is configured to display the image region selected by the first input in the form of a cropped preview image; in the case that the multimedia content includes audio, the preview window is configured to display the audio segment selected by the first input in the form of a time interval marker and / or an audio waveform diagram; in the case that the multimedia content includes video, the preview window is configured to display the video segment selected by the first input in the form of a time interval marker and / or a key frame thumbnail; wherein the time interval marker includes a start time and an end time.
[0123] Optionally, as one embodiment, the processor 1010 is further configured to, in the case that a plurality of preview windows are displayed, in response to a third input, perform splicing processing on the multimedia content in at least two preview windows selected by the third input to obtain a spliced preview window; wherein the spliced preview window is configured to display the spliced multimedia content, and the splicing processing includes at least one of horizontal parallel splicing, vertical stacking splicing and intelligent layout splicing based on a preset template.
[0124] Optionally, as one embodiment, in the case that the multimedia content includes an image, the editing processing includes at least one of adjusting a text attribute of the image, modifying an image parameter, applying a filter effect to a selected region, and resetting a cropping range; the text attribute includes at least one of font, font size, color and alignment; the image parameter includes at least one of size, position, rotation angle and transparency; in the case that the multimedia content includes audio or video, the editing processing includes at least one of recombining audio segments or video segments, adding metadata, and inserting annotation information at a key frame position; the metadata includes at least one of title, description and cover image.
[0125] Optionally, as an embodiment, in a case that the electronic device is a non-folded screen device, the editing area is a preset area on a screen of the non-folded screen device; in a case that the electronic device is a folded screen device, the editing area is a folding area of the folded screen device; wherein the folding area includes at least two sub-areas, and each of the sub-areas corresponds to a different editing processing mode.
[0126] Optionally, as an embodiment, the display unit 1006 is further configured to display the preview image after the editing processing in real time in the editing effect preview area.
[0127] Optionally, as an embodiment, the processing result includes at least one of an image and an interactive card.
[0128] It should be understood that, in the embodiments of the present application, the input unit 1004 can include a graphics processing unit (GPU) 10041 and a microphone 10042. The graphics processing unit 10041 processes image data of a still image or a video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1006 can include a display panel 10061, which can be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1007 includes at least one of a touch panel 10071 and an input device 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 can include a touch detection device and a touch controller. The input device 10072 can include, but is not limited to, a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), trackballs, mice, joysticks, etc., which will not be described here.
[0129] The memory 1009 can be used to store software programs and various data. The memory 1009 can mainly include a first storage area storing programs or instructions and a second storage area storing data, wherein the first storage area can store an operating system, application programs or instructions required by at least one function (such as a sound playing function, an image playing function, etc.), etc. In addition, the memory 1009 can include a volatile memory or a non-volatile memory, or the memory 1009 can include both volatile and non-volatile memories. The non-volatile memory can be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a Random Access Memory (RAM), a Static RAM (SRAM), a Dynamic RAM (DRAM), a Synchronous DRAM (SDRAM), a Double Data Rate SDRAM (DDR SDRAM), an Enhanced SDRAM (ESDRAM), a Synchlink DRAM (SLDRAM), and a Direct Rambus RAM (DRRAM). The memory 1009 in the embodiments of the present application includes but is not limited to these and any other suitable types of memories.
[0130] The processor 1010 can include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and an application program, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 1010.
[0131] The embodiments of the present application also provide a readable storage medium, and the readable storage medium stores programs or instructions, the programs or instructions are executed by a processor to realize various processes of the above-mentioned information processing method embodiments and achieve the same technical effects. To avoid repetition, details are not described here.
[0132] The processor is a processor in the electronic device in the above embodiments. The readable storage medium includes a computer readable storage medium, such as a computer readable only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0133] The chip provided in the embodiments of the present application includes a processor and a communication interface. The communication interface is coupled with the processor. The processor is configured to execute programs or instructions to implement various processes of the above information processing method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.
[0134] It should be understood that the chip mentioned in the embodiments of the present application can also be referred to as a system-level chip, a system chip, a chip system, or a system-on-chip, etc.
[0135] The embodiments of the present application also provide a computer program product stored in a storage medium. The program product is executed by at least one processor to implement various processes of the above information processing method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.
[0136] It should be noted that in this document, the terms "comprising", "including", or any variation thereof are intended to cover non-exclusive inclusion, so that processes, methods, articles, or devices including a series of elements not only include those elements, but also include elements not explicitly listed, or include elements inherent to such processes, methods, articles, or devices. Without more limitations, the element defined by the statement "including a" does not exclude the presence of additional identical elements in the process, method, article, or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to the order of performing the functions as shown or discussed, but can also include performing the functions in a substantially simultaneous manner or in a reverse order, for example, the described method can be performed in an order different from the described order, and various steps can be added, omitted, or combined. In addition, the features described with reference to certain examples can be combined in examples.
[0137] From the above description of the embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be realized by means of software and necessary general hardware platforms, of course, they can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, or optical disk), and includes a plurality of instructions for making a terminal (such as a mobile phone, computer, server, or network device, etc.) execute the methods of various embodiments of the present application.
[0138] The embodiments of the present application are described above with reference to the accompanying drawings, but the present application is not limited to the above-described specific embodiments, and the above-described specific embodiments are merely illustrative, but not restrictive, and a person of ordinary skill in the art can make many forms under the inspiration of the present application without departing from the purpose of the present application and the scope protected by the claims.
Claims
1. An information processing method characterized by comprising: The method is executed by an electronic device, and the method comprises: displaying a preview window in response to a first input; wherein the preview window is used to display multimedia content selected by the first input, and the multimedia content comprises at least one of the following: text, an image, audio, and a video; editing the multimedia content displayed in the preview window selected by a second input in an editing area to obtain a processing result.
2. The method of claim 1, wherein, in a case where the multimedia content comprises text, the preview window is used to display the text selected by the first input in the form of an image; in a case where the multimedia content comprises an image, the preview window is used to display an image region selected by the first input in the form of a cropped preview image; in a case where the multimedia content comprises audio, the preview window is used to display an audio segment selected by the first input in the form of time interval marking and / or an audio waveform diagram; in a case where the multimedia content comprises a video, the preview window is used to display a video segment selected by the first input in the form of time interval marking and / or a key frame thumbnail; wherein the time interval marking comprises a start time and an end time.
3. The method of claim 1, wherein, The method further comprises: in a case where a plurality of preview windows are displayed, in response to a third input, splicing the multimedia content in at least two preview windows selected by the third input to obtain a spliced preview window; wherein the spliced preview window is used to display spliced multimedia content, and the splicing process comprises at least one of the following: horizontal parallel splicing, vertical stacking splicing, and intelligent layout splicing based on a preset template.
4. The method of claim 1, wherein, in a case where the multimedia content comprises an image, the editing process comprises at least one of the following: adjusting text attributes of the image, modifying image parameters, applying filter effects to a selected region, and resetting a cropping range; the text attributes comprise at least one of the following: font, font size, color, and alignment; and the image parameters comprise at least one of the following: size, position, rotation angle, and transparency; in a case where the multimedia content comprises audio or a video, the editing process comprises at least one of the following: recombining audio segments or video segments, adding metadata, and inserting annotation information at a key frame position; the metadata comprises at least one of the following: title, description, and cover image.
5. The method of claim 1, wherein, in a case where the electronic device is a non-foldable screen device, the editing area is a preset area on a screen of the non-foldable screen device; in a case where the electronic device is a foldable screen device, the editing area is a folding area of the foldable screen device; wherein the folding area comprises at least two sub-areas, and each sub-area corresponds to a different editing processing mode.
6. The method of claim 1, wherein, The method further comprises: The preview image after the editing processing is displayed in real time in an editing effect preview area.
7. The method of claim 1, wherein, The processing result includes at least one of an image and an interactive card.
8. An information processing apparatus, characterized by comprising: The device includes The display module is configured to display a preview window in response to a first input, wherein the preview window is configured to display multimedia content selected by the first input, and the multimedia content includes at least one of a text, an image, an audio, and a video. The processing module is configured to perform editing processing on the multimedia content displayed in the preview window in response to a second input, and obtain a processing result.
9. An electronic device, comprising: The electronic device includes a processor and a memory, and the memory stores programs or instructions executable on the processor, and the programs or instructions are executed by the processor to implement the steps of the information processing method according to any one of claims 1 to 7.
10. A readable storage medium, characterized by, The readable storage medium stores programs or instructions, and the programs or instructions are executed by the processor to implement the steps of the information processing method according to any one of claims 1 to 7.